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Optimal Structured Static State-Feedback 
Control Design with Limited Model Information 
for Fully- Actuated Systems*"'" 

Farhad Farokhif Cedric Langbort^ and Karl H. Johansson^ 

Abstract 

We introduce the family of limited model information control design 
methods, which construct controllers by accessing the plant's model in a 
constrained way, according to a given design graph. We investigate the 
closed-loop performance achievable by such control design methods for 
fully-actuated discrete-time linear time-invariant systems, under a sepa- 
rable quadratic cost. We restrict our study to control design methods 
which produce structured static state feedback controllers, where each 
subcontroller can at least access the state measurements of those subsys- 
tems that affect its corresponding subsystem. We compute the optimal 
control design strategy (in terms of the competitive ratio and domination 
metrics) when the control designer has access to the local model informa- 
tion and the global interconnection structure of the plant-to-be-controlled. 
Lastly, we study the trade-off between the amount of model information 
exploited by a control design method and the best closed-loop performance 
(in terms of the competitive ratio) of controllers it can produce. 

1 Introduction 

Many modern control systems, such as aircraft and satellite formation [HH], au- 
tomated highways and other shared infrastructure [UG3, flexible structures [BJ, 
and supply chains [7] , consist of a large number of subsystems coupled through 
their performance goals or system dynamics. When regulating this kind of plant, 
it is often advantageous to adopt a distributed control architecture, in which 
the controller itself is composed of interconnected sub-controllers, each of which 
accesses a strict subset of the plant's output. Several control synthesis methods 
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have been proposed over the past decades that result in distributed controllers 
of this form, with various types of closed-loop stability and performance guar- 
antees (e.g., [SHE])- Most recently, the tools presented in [T7] and [IB] revealed 
how to exploit the specific interconnection of classes of plants (the so-called 
quadratically invariant systems) to formulate convex optimization problems for 
the design of structured H^- and Hi- optimal controllers. A common thread in 
this part of the literature is the assumption that, even though the controller is 
structured, its design can be performed in a centralized fashion, with full knowl- 
edge of the plant model. However, in some applications (described in more detail 
in the next paragraph), this assumption is not always warranted, as the design 
of each subcontrollcr may need to be carried out by a different control designer, 
with no access to the global model of the plant, although its interconnection 
structure and the common closed-loop cost function to be minimized are public 
knowledge. This class of problems, which we refer to as "limited model infor- 
mation control design problems" , is the main object of interest in the present 
paper. 

Limited model information control design occurs naturally in contexts where 
the subsystems belong to different entities, which may consider their model in- 
formation private and may thus be reluctant to share it with others. In this 
case, the designers may have to resort to "communication-less" strategies in 
which subcontrollcr Ki depends solely on the description of subsystem i's model. 
This case is well illustrated by supply chains, where the economic incentives of 
competing companies might limit the exchange of model information (such as, 
inventory volume, transportation efficiency, raw material sources, and decision 
process) inside a layer of the chain. Another reason for using communication- less 
strategies in more general design situations, even when the circulation of plant 
information is not restricted a priori, is that the resulting subcontrollcr Ki does 
not need to be modified if the characteristics of a particular subsystem, which 
is not directly connected to subsystem i, vary. For instance, consider a chemical 
plant in the process industry, with thousands of local controllers. In such a 
large-scale system, the tuning of each local controller should not require model 
parameters from other parts of the system so as to simplify maintenance and 
limit controller complexity. Note that engineers often implement these large- 
scale systems as a whole using commercially available pre-designed modules. 
These modules are designed, in advance, with no prior knowledge of their pos- 
sible use or future operating condition. This lack of availability of the complete 
model of the plant, at the time of the design, constrains the designer to only 
use its own model parameters in each module's control design. 

Control design based on uncertain plant model information is a classic topic 
in the robust control literature 19 22 . However, designing an optimal controller 
without a global model is different from a robust control problem. In optimal 
control design with limited model information, subsystems do not have any 
prior information about the other subsystems' model; i.e., there is no nominal 
model for the design procedure and there is no bound on the model uncertain- 
ties. There have been some interesting approaches for tackling this problem. 
For instance, references j23f[2l)] introduced methods for designing sub-optimal 
decentralized controllers without a global dynamical model of the system. In 
these papers, the authors assume that the large-scale system to be controlled 
consists of an interconnection of weakly coupled subsystems. They design an 
optimal controller for each subsystem using only the corresponding local model, 
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and connect the obtained subcontrollers to construct a global controller. They 
show that, when coupling is negligible, this latter controller is satisfactory in 
terms of closed-loop stability and performance. However, as coupling strength 
increases, even closed-loop stability guarantees are lost. Other approaches such 
as [5j[7] are based on receding horizon control and use decomposition methods 
to solve each step's optimization problem in a decentralized manner with only 
limited information exchange between subsystems. What is missing from the 
literature, however, is a rigorous characterization of the best closed-loop per- 
formance that can be attained through limited model information design and, 
a study of the trade off between the closed-loop performance and the amount 
of exchanged information. We tackle this question in the present paper for a 
particular class of systems (namely, the set of fully-actuated discrete-time lin- 
ear time-invariant dynamical systems) and a particular class of control laws 
(namely, the set of structured linear static state feedback controllers where each 
subcontroller can at least access the state measurements of those subsystems 
that affect its corresponding subsystem). 

In this paper, we study the properties of limited model information control 
design methods. Wc investigate the relationship between the amount of plant 
information available to the designers, the nature of the plant interconnection 
graph, and the quality (measured by the closed-loop control goal) of controllers 
that can be constructed using their knowledge. To do so, we look at limited 
model information and communication-less control design methods as belonging 
to a special class of maps between the plant and controller sets, and make use 
of the competitive ratio and domination metrics introduced in |27| to charac- 
terize their intrinsic limitations. To the best of our knowledge, there are no 
other metrics specifically tuned to control design methods. We address much 
more general classes of subsystems and of limitations on the model information 
available to the designer than is done in [27]. Specifically, we consider limited 
model information structured static state-feedback control design for intercon- 
nections of fully-actuated (i.e., with invertible B- matrix) discrete-time linear 
time-invariant subsystems with quadratic separable (i.e., with block diagonal Q- 
and i?-matrices) cost function. Our choice of such a cost function is motivated 
by our interest in applications such as power grids p5H3T| and [SJ Chs. 5,10], 
supply chains [71I3T]. and water level control [5J Ch. 18], which have been shown 
to be well-modeled by dynamically-coupled but cost-decoupled interconnected 
systems. We show in the last section of the paper that the assumption on the 
B-matrix can be partially removed for the sinks (i.e., subsystems that cannot 
affect any other subsystem) in the plant graph. 

We investigate the best closed-loop performance achievable by structured 
static state feedback controllers constructed by limited model information design 
strategies. We show that the result depends crucially on the plant graph and the 
control graph. In the case where the plant graph contains no sink and the control 
graph is a supcrgraph of the plant graph, we extend the fact proven in |27j that 
the deadbeat strategy is the best communication-less control design method. 
However, the deadbeat control design strategy is dominated when the plant 
graph has sinks, and we exhibit a better, undominated, communication-less 
control design method, which, although having the same competitive ratio as the 
deadbeat control design strategy, takes advantage of the knowledge of the sinks' 
location to achieve a better closed-loop performance in average. We characterize 
the amount of model information needed to achieve better competitive ratio than 
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the deadbeat control design strategy. This amount of information is expressed 
in terms of properties of the design graph; a directed graph which indicates 
the dependency of each subsystem's controller on different parts of the global 
dynamical model. 

This paper is organized as follows. After formulating the problem of interest 
and defining the performance metrics in Section [5J we characterize the best 
communication-less control design method according to both competitive ratio 
and domination metrics in Section [3] In Section 01 we show that achieving a 
strictly better competitive ratio than these control design methods requires a 
complete design graph when the plant graph is itself complete. Finally, we end 
with a discussion on extensions in Section [5] and the conclusions in Section [6] 

1.1 Notation 

Sets will be denoted by calligraphic letters, such as V and A. If A is a subset 
of M. then A c is the complement of A in A4, i.e., Ai \ A. 

Matrices are denoted by capital roman letters such as A. Aj will denote the 
j th row of A. Aij denotes a sub-matrix of matrix A, the dimension and the 
position of which will be defined in the text. The entry in the i th row and the 
j th column of the matrix A is a^. 

Let S'l, (S r h) be the set of symmetric positive definite (positive semidefinite) 
matrices in M. nxn . A > (>)0 means that the symmetric matrix A £ M. nxn is 
positive definite (positive semidefinite) and A > (>)B means that A — B > (>)0. 

A(y) and X(Y) denote the smallest and the largest eigenvalues of the matrix 
Y, respectively. Similarly, gJY) and a(Y) denote the smallest and the largest 
singular values of the matrix Y, respectively. Vector denotes the column- 
vector with all entries zero except the i th entry, which is equal to one. 

All graphs considered in this paper are directed, possibly with self- loops, 
with vertex set {1, ...,q} for some positive integer q. If G = ({1, ...,q},E) is a 
directed graph, we say that i is a sink if there does not exist j ^ i such that 
£ E. A loop of length t in G is a set of distinct vertices ...,it} such 
that (it, i\) £ E and (i p , i v +\) £ E for all 1 < p < t — 1. We will sometimes refer 
to this loop as (i\ — > %2 —>•••—> it — > The adjacency matrix S of graph G 
is the gxij matrix whose entries satisfy 



Since the set of vertices is fixed here, a subgraph of G is a graph whose edge set 
is a subset of the edge set of G and a supergraph of G is a graph of which G is 
a subgraph. We use the notation G' 5 G to indicate that G' is a supergraph of 



2 Control Design with Limited Model Informa- 
tion 

In this section, we introduce the system model and the problem under consid- 
eration, but first, we present a simple illustrative example. 
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2.1 Illustrative Example 



Consider a discrete-time linear time-invariant dynamical system composed of 
three subsystems represented in state-space form as 
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where, for each subsystem i, Xi{k) € R is the state and Uj(fc) e M is the con- 
trol signal. This system, which is illustrated in Figure [TJ is a simple networked 
control system. Networked control systems have several important character- 
istics. First, they are often distributed geographically. Therefore, it is natural 
to assume that a given subsystem can only influence its neighboring subsys- 
tems. We capture this fact using a directed graph called the plant graph like 
the one presented in Figure [2ja) for this example. This star graph corresponds 
to applications like unmanned aerial vehicles formation, platoon of vehicles, and 
composite formations of power systems |33U34| . 

Second, any communication medium that we use to transmit the sensor 
measurements and actuation signals in networked control systems brings some 
limitations. For instance, every communication network has band-limited chan- 
nels. Therefore, when designing subcontrollcrs, it might not make sense to 
assume that it can instantaneously access full state measurements of the plant. 
The state measurement availability in this example is 
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We use a control graph to characterize the controller structure. Control graph 
G/c in Figure [2j6) represents the state-measurement availability in this exam- 
ple. It corresponds to the case where neighboring subsystems transmit their 
state-measurements to each other, which is common for unmanned aerial vehi- 
cles formation, autonomous ground vehicles platoons, and biological system of 
particles E0EJG22I31 . 

Finally, in large-scale dynamical systems, it might be extremely difficult 
(if not impossible) to identify all system parameters and update them globally. 
One can only hope that the designer has access to the local parameter variations 
and update the corresponding subcontroller based on them. Therefore, it makes 
sense to assume that each local controller only has access to model information 
from its corresponding subsystem; i.e., designer of subcontroller i uses only 
{an, a,2, a^} in the design procedure 

[hi k l2 ki3}=Ti([an a i2 0,3], 

where : R 3 x R — > K 3 is the control design map. Note that the block-diagram 
in Figure [1] does not specify T. We will use a directed graph called the design 
graph to capture structural properties of T. In the rest of this section, we 
formalize the above notions for more general design problems. 
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2.2 Plant Model 



Let a graph Gp = ({1, q}, E-p) be given, with adjacency matrix S-p £ 
{0, l} qxq . We define the following set of matrices associated with S-p: 

A(S V ) = {A £ R nxn I A if = £ R n * xn i for all 

(1) 

1 < h j < 1 such that (s-p)ij = 0}, 

where for each 1 < i < q, integer number rij is the dimension of subsystem i. 
Implicit in these definitions is the fact that ^i=i n i = n - Also, for a given scalar 
e > 0, we let 

B{e) = {B £ « nxn | a(B) > e, By = e R™ ! X " J for all 1 < i ^ j < q}. (2) 

The set 0(e) defined in $2$ is made of invertible block-diagonal square matrices 
since q_(B) > e > for each matrix B £ £>(e) C R™ xn . With these definitions, 
we can introduce the set V of plants of interest as the space of all discrete-time 
linear time-invariant dynamical systems of the form 

x{k + 1) = Ax(k) +Bu(k) ; x(0) = x , (3) 

with A £ A(S V ), B £ 3(e), and x £ M™. Clearly V is isomorph to A{S V ) x 
B(e) x R" and, slightly abusing notation, we will thus identify a plant P £ V 
with the corresponding triple (A, B, xq). 

A plant P £ V can be thought of as the interconnection of q subsystems, with 
the structure of the interconnection specified by the graph G-p (i.e., subsystem 
j's output feeds into subsystem i only if £ E-p). As a consequence, we 
refer to G-p as the "plant graph" . We will denote the ordered set of state indices 
pertaining to subsystem i as I;; i.e., := (1 + Y^j=\ Tij, . . ■ ,rii + Sj=i n j)- F° r 
subsystem i, state vector and input vector are defined as 

where the ordered set of indices (£\ , . . . , £ ni ) = Ti , and its dynamics is specified 

by 

x^k + 1) = A rjXj{k) + BaUiik). 

3=1 

According to the specific structure of B(e) given in each subsystem is fully- 
actuated, with as many input as states, and controllable in one time-step. Pos- 
sible generalization of the results to a (restricted) family of under-actuated sys- 
tems is discussed in Section [5] 

Figure EJa) shows an example of a plant graph G p . Each node represents a 
subsystem of the system. For instance, the second subsystem in this example 
may affect the first subsystem and the third subsystem; i.e., sub- matrices A12 
and A32 can be nonzero. The self-loop for the second subsystem shows that A22 
may be non-zero. The plant graph Gp in Figure HJa) does not contain any sink. 
In contrast, the first subsystem of the plant graph G' v in Figure HJa') is a sink. 
The control graph Gk: is introduced in the next subsection. 
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Figure 1: Physical interconnection between different subsystems and controllers 
corresponding to G-p and G/c in Figures Ufa) and [2^6), respectively. 
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Figure 2: G-p and G^, are examples of plant graphs, G/c and G' K are examples 
of control graphs, and Gq and G' c are examples of design graphs. 



2.3 Controller Model 

Let a control graph G/c be given, with adjacency matrix Sjc. The control laws 
of interest in this paper are linear static state-feedback control laws of the form 

u(k) = Kx(k), 

where 

K 6 IC{S K ) = {K e W nxn \Kij = e M'"' x "' for 

all 1 < ij j < <1 such that (s^;)ij = 0}. 

In particular, when G/c is a complete graph, IC(Sic) = K nx ™, while, if G/c is to- 
tally disconnected with self-loops, IC(Sfc) represents the set of fully-decentralized 
controllers. When adjacency matrix Sjc is not relevant or can be deduced from 
context, we refer to the set of controllers as JC. 

An example of a control graph G/c is given in Figure W[b). Each node repre- 
sents a subsystem-controller pair of the overall system. For instance, Figure^?)) 
shows that the first subsystem's controller can use state measurements of the 
second subsystem besides its own state measurements. Figure shows a 

complete graph, which indicates that each subsystem has access to full state 
measurements of all other subsystems; i.e., K.(S/c) = M. nxn . 



2.4 Linear State Feedback Control Design Methods 

A control design method T is a map from the set of plants V to the set of 
controllers JC. Just like plants and controllers, a control design method can 
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exhibit structure which, in turn, can be captured by a design graph. Let a 
control design method T be partitioned according to subsystems dimensions as 

r = 



and a graph Gc = ({1, <?}, Eq) be given, with adjacency matrix Sc- Each 
block Tij represents a map A{S-p) x B(e) — > R"> x ™j . Control design method V 
can be further partitioned in the form 

711 ' • • 7ln 
7nl ' ' ' Inn 

where each 7^ is a map A(S-p) x B(e) R. We say that Y has structure Gc if, 
for all i, the map [Tn ■ • ■ Ti q ] is only a function of 

{[Aji ••• Ah],Bh I (sch^O}. (6) 

In words, a control design method has structure Gc if and only if, for all i, 
the subcontroller of subsystem i is constructed with knowledge of the plant 
model of only those subsystems j such that (j, i) £ Ec- The set of all control 
design methods with structure Gc will be denoted by C. In the particular case 
where Gc is the totally disconnected graph with self-loops (meaning that every 
node in the graph has a self-loop; i.e, Sc = I q ), we say that a control design 
method in C is "communication-less" , so as to capture the fact that subsystem 
i's subcontroller is constructed with no information coming from (and, hence, 
no communication with) any other subsystem j, j 7^ i. Therefore, the design 
graph indicates knowledge (or lack thereof) of entire block rows in the aggregate 
system matrix. When Gc is not a complete graph, we refer to T £ C as being 
"a limited model information control design method" . 

Note that C can be considered as a subset of the set of functions from A(S-p) x 
B(e) to /C(Sx), since a design method with structure Gc is not a function of 
initial state xq. Hence, when T E C we will write T(A, B) instead of T(P) for 
plant P = (A,B,x ) G V. 

An example of a design graph Gc is given in Figure Wi c ) ■ Each node repre- 
sents a subsystem-controller pair of the overall system. For instance, Gc shows 
that the third subsystem's model is available to the designer of the second sub- 
system's controller but not the first subsystem's model. Figure [U[c') shows a 
fully disconnected design graph with self- loops G' c . A local designer in this 
case can only rely on the model of its corresponding subsystem; i.e., the design 
strategy is communication-less. 

2.5 Performance Metrics 

The goal of this paper is to investigate the influence of the plant and design 
graph on the properties of controllers constructed by limited model information 
control design methods. To this end, we will use two performance metrics 
for control design methods. These performance metrics are adapted from the 
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notions of competitive ratio and domination introduced in [57], so as to take 
plant, controller, and control design structures into account. Following the 
approach in |27j . we start by associating a closed- loop performance criterion 
to each plant P = (A,B,xo) £ V and controller K £ JC. As explained in the 
introduction, we are particularly interested in dynamically-coupled but cost- 
decoupled systems in this paper, hence, we use a cost of the form 

oo oo 

Jp(K) = J2 x(k) T Qx(k) + u(k) T Ru(k), (7) 

fe=l k=0 

where Q £ 5" + and R £ S*™ + are block diagonal matrices, with each diagonal 
block entry belonging to S" z + . Note that the summation in the first term on 
the right-hand side of © starts from k = 1. This is without loss of generality 
as the removed term x(0) T Qx(0) is not a function of the controller. We make 
the following two standing assumptions: 

Assumption 2.1. Q = R = I . 

This is without loss of generality because the change of variables (x, u) = 
(Q x / 2 x, R}-I 2 u) transforms the performance criterion and state space represen- 
tation into 

oo oo 

Jp{K) = ^2 x(k) T x(k) + ^2 u(k) T u{k), (8) 

k=l k=0 

and 

x(k + 1) = Q 1 ' 2 AQ- 1 ' 2 x{k) + Q 1 ' 2 BR- 1 ' 2 u{k) 
= Ax(k)+Bu{k), 

respectively, without affecting the plant, control, or design graph (due to the 
block diagonal structure of Q and R) . 

Assumption 2.2. The set of matrices B(e) is replaced with the set of diagonal 
matrices with diagonal entries greater than or equal to e. 

This assumption is without loss of generality. Indeed, consider a plant 
P = (A, B, xq) £ V . Every sub-system's Ba matrix has a singular value decom- 
position Bu = UuYjiiV? with Tin > e/„ iXrii . Combining these singular value 
decompositions together results in a singular value decomposition for matrix 
B = UZV T where U = diag(t/ u , U 22 , ■ • • , U„), E = diag(S u , S 22 , ■ • • , E OT ), 
and V = diag(F u , V 22 , ■•■ , V qq ). Defining x{k) = U T x{k) and u{k) = V T u{k) 
results in 

x{k + 1) = U T AUx{k) + U T BVu{k), 

where U T BV is diagonal. Because of the block diagonal structure of matrices 
U and V, the change of variables (A, B, xq) H> (U t AU, U t BV, U t xo) does not 
affect the plant, control, or design graph. In addition, the cost function becomes 

oo oo 

J P (K) = Y x(k) T U T Ux(k) + ^2 u(k) T V T Vu{k) 

k=l k=0 

oo oo 

= ^2 x(k) T x(k) + J2 u{k) T u{k), 

k=l k=0 
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which is of the form ©, because both U and V are unitary matrices. We are 
now ready to define the performance metrics of interest in this paper. 

Definition 2.3. (Competitive Ratio) Let a plant graph G-p, control graph G/c 
and constant e > be given. Assume that, for every plant P £ P, there exists 
an optimal controller K*(P) € JC such that 

J P {K*{P)) < J P (K), VA" G JC. 

The competitive ratio of a control design method T is defined as 

fr , J P (T(A,B)) 
r v (T) = sup - , T ^, P ^ , 

p=(A,B,x )er j p( k (P)) 

with the convention that " equals one. 

Note that the mapping K* : P — > K*(P) is not itself required to lie in the 
set C, as every component of the optimal controller may depend on all entries 
of the model matrices A and B. 

Definition 2.4. (Domination) A control design method T is said to dominate 
another control design method V if 

Jp(T(A,B))<J P (T'(A,B)), VP= (A,B,x ) eP, (9) 

with strict inequality holding for at least one plant in P. When V G C and no 
control design method T £ C exists that satisfies we say that V is undomi- 
nated in C for plants in P. 



2.6 Problem Formulation 

With the definitions of the previous subsections in hand, we can reformulate 
the main question of this paper regarding the connection between closed-loop 
performance, plant structure, and limited model information control design as 
follows. For a given plant graph, control graph, and design graph, we would like 
to determine 

argminrp(r). (10) 

Since several design methods may achieve this minimum, we are interested in 
determining which ones of these strategies arc undominated. 

In [57], this problem was solved in the case when G-p and Gjc are complete 
graphs, Gc is a totally disconnected graph with self-loops (i.e., Sc = I q ), and 
B(e) is replaced with singleton {/„}• In this paper, we investigate the role of 
more general plant and design graphs. We also extend the results in [57] for 
scalar subsystems to subsystems of arbitrary order rij > 1, 1 < i < q. 



3 Plant Graph Influence on Achievable Perfor- 
mance 

In this section, we study the relationship between the plant graph and the 
achievable closed-loop performance in terms of the competitive ratio and dom- 
ination. 
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Definition 3.1. The deadbeat control design method T A : A(S-p) x £>(e) — > JC 
is defined as 



This control design method is communication- less; i.e., the control design for 
the subsystem i is a function of the model of subsystem i only, because subsystem 
i's controller gain [T$(A,B) ■■■ T^(A,B)] equals to B^ 1 [A a ■■■ A lq \. The 
name "deadbeat" comes from the fact that the closed-loop system obtained by 
applying controller T A (A, B) to plant P = (A, B 1 xq) reaches the origin in just 
one time-step [57] . 

Remark 3.2. Note that for the case where the control graph G/c is a complete 
graph; i.e., K. = W nxn , there exists a controller K*(P) satisfying the assump- 
tions of Definition \2.3\ for all P € V , namely, the optimal linear quadratic 
regulator which is independent of the initial condition of the plant. For incom- 
plete control graphs, the optimal control design strategy K*(P) (if exists) might 
become a function of the initial condition ]38$ . Hence, we will use K*(A,B) 
instead of K* (P) when the control graph Gfc is a complete graph for each plant 
P = {A, B, xq) € V to emphasize this fact. 

From Definition 12.31 the notation K*(P) is reserved for the optimal con- 
trol design strategy for any given control graph Gx. In contrast, when G/c is 
not the complete graph, we will refer to the optimal unstructured controller as 



Lemma 3.3. Let the control graph G/c be a complete graph. The cost of the 
optimal control design strategy K* is lower-bounded by 



Theorem 3.4. Let the plant graph G-p contain no isolated node and G/c 2 G-p. 
Then the competitive ratio of the deadbeat control design method T A is 



Proof: Irrespective of the control graph Gk: and for all plants P £ V , it is 



V (A, B) = -B 



A, for all P = (A, B, x Q ) e V. 



K* C (A,B). 




for all plants P = (A, B, xq) G V . 
Proof: Sec Appendix El 



MT A ) = l + l/e 2 . 




(11) 



j P (r A (A,B)) ^ 1 , i 



(12) 



J P (K* C (A,B)) ~ £ 2 (-B) ! 
for all P = (A, B, x ) E V. Combining (12]) and ((III) results in 
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To show that this upper bound is attained, let us pick i\ € Ti and j\ £ Xj where 
1 £ ' 7^ j ^ 9 an d (s-p)ij (such indices i and j exist because plant graph 
G-p has no isolated node by assumption). Consider the system A = e^e^ and 
B = el. The unique positive definite solution of the discrete algebraic Riccati 
equation 

A T XA - A T XB{I + B T XB)- 1 B T XA = X - I, (13) 

is X = I+[l/(l+e 2 )]ej 1 eJ 1 . Consequently, the centralized controller A, B) = 
— e/(l + e 2 )ei 1 ej i belongs to the set K(Sic) because Gx 2 G-p. Thus, we get 

J {A ,B, ejl ){K*{A,B,e h )) < J {A , B>eji) {K* c {A,B)) (14) 

since K*(P) has a lower cost than any other controller in fC(S)c). On the other 
hand, it is evident that 

J ( A,B, ejl )(K* c (A,B)) < J {AtBie . D (K*(A,B,e h )) (15) 

because the centralized controller has access to more state measurements. Us- 
ing (|T4|) and (fl5|) simultaneously results in 

J { A,B,e Jl} (K*(A,B,e n )) = J (A , B<eji) {K* c {A,B)) 

= l/(l + £ 2 ). 

On the other hand T A (A, B) = -[l/e]e ll ej i and J^ B e .^^(T A (A, B)) = 1/e 2 . 
Therefore, r-p(T A ) = 1 + 1/e 2 . ■ 

Remark 3.5. Consider the limited model information design problem given by 
the plant graph Gp in Figure\^fa) and the control graph G'^ in Figure \^(b' ) . 
Theorem \3.4\ shows that, if we apply the deadbeat control design strategy to this 
particular problem, the performance of the deadbeat control design strategy, at 
most, can be 1 + 1/e 2 times the cost of the optimal control design strategy K* . 
For instance, when B = {1} as in \2 r l\ , we have 1 + 1/e 2 = 2 since in this case 
e = 1. Therefore, the deadbeat control design strategy is never worse than twice 
the optimal controller in this case. 

Remark 3.6. There is no loss of generality in assuming that there is no isolated 
node in the plant graph Gp , since it is always possible to design a controller for 
an isolated subsystem without any model information about the other subsystems 
and without impacting cost In particular, this implies that there are q > 2 
vertices in the graph because for q = 1 the only subsystem that exists is an 
isolated node in the plant graph. 

Remark 3.7. For implementation of the deadbeat control design strategy in each 
node, we only need the state measurements of the neighbors of that node. For 
the implementation of the optimal control design strategy K* when the control 
graph has many more links than the plant graph, the controller gain K*{P) is 
not necessarily a sparse matrix. 

With this characterization of T A in hand, we are now ready to tackle prob- 
lem ([TO]) . 
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3.1 First case: plant graph G-p with no sink 

In this subsection, we show that the deadbcat control method T A is undomi- 
nated by communication-less control design methods for plants in V , when G-p 
contains no sink. We also show that T A exhibits the smallest possible competi- 
tive ratio among such control design methods. First, we state the following two 
lemmas. 

Lemma 3.8. Let the plant graph Gp contain no isolated node, the design graph 
Gq be a totally disconnected graph with self-loops, and Gjc 12 G-p. A control de- 
sign method T G C has bounded competitive ratio only if the following implication 
holds for all 1 < i < q and all j : 

a ej = for all I E X { ^> Jij(A, B) = for all fel„ 
whereli is the set of indices related to subsystemi; i.e., Ii = (l+XTz=i n z> ■ ■ ■ > n «+ 

Proof: See Appendix iBl ■ 

Lemma 3.9. Let the plant graph Gp contain no isolated node, the design graph 
Gc be a totally disconnected graph with self-loops, and Gk. 12 Gp. Assume the 
plant graph Gp has at least one loop. Then, 

rp(T)> 1 + 1/e 2 (16) 

for all limited model information control design method T in C. 

Proof: See Appendix [Cl ■ 

Using these two lemmas, we are ready to state and prove one of the main 
theorems in this paper and, as a result, find the solution to problem (|10p when 
the plant graph Gp contains no sink. 

Theorem 3.10. Let the plant graph Gp contain no isolated node and no sink, 
the design graph Gc be a totally disconnected graph with self-loops, and Gk: 12 
Gp . Then the competitive ratio of any control design strategy T € C satisfies 

r v (T) > 1 + 1/e 2 . 

Proof: From Lemma 1.4.23 in |39j . we know that a directed graph with no 
sink must have at least one loop. Hence Gp must contain a loop. The result 
then follows from Lemma 1331 ■ 

Remark 3.11. Theorem WAlK shows thatr v {Y) > rp(T A ) for any control design 
strategy T € C , and as a result the deadbeat control design method T A becomes a 
minimizer of the competitive ratio function rp over the set of communication- 
less design methods. 

We now turn our attention to domination properties of the deadbeat control 
design strategy. 

Lemma 3.12. Let the plant graph Gp contain no isolated node, the design 
graph Gc be a totally disconnected graph with self-loops, and Gk: 12 Gp. The 
deadbeat control design strategy T A is undominated, if there is no sink in the 
plant graph Gp. 
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Proof: See Appendix [D] ■ 

The following theorem shows that the dcadbeat control design strategy is 
undominatcd by communication-less design methods if and only if the plant 
graph G-p has no sink. It thus provides a good trade-off between worst-case and 
average performance. 

Theorem 3.13. Let the plant graph Gp contain no isolated node, the design 
graph Gq be a totally disconnected graph with self-loops, and G/c 3 G-p. Then 
the deadbeat control design method T A is undominated in C for plants in V if 
and only if the plant graph Gp has no sink. 

Proof: Proof of the "if" part of the theorem, is given by Lemma 13.121 
For ease of notation in this proof, we use [T]j = [Pi • • • Ti q ] and [A]i = 
[An ■■■ A iq \. 

In order to prove the "only if" part of the theorem, we need to show that 



if the plant graph has a sink (i.e., if there exists j such that (sp) 



for 



every i ^ j), then there exists a control design method T which dominates the 
dcadbeat control design method. We exhibit such a strategy. 

Without loss of generality, we can assume that {sp)i q = for all i ^ q, in 
which case every matrix A in A(Sp) has the structure 



-4 



An 

A q -i A 

Aql 



A,a- 



9-1 







Aq-l.q-1 
Aq,q-1 A 



<l<l 



Define xq = [ Xi(0) ■ ■ ■ x q -i(0) ] T , and let control design strategy T be 
defined by 



-B^Au 



-B 



5-1,9—1-^5-1,1 

K ql (A, B) 



—B X1 A\^i 







-B 



-l 



5-1,9-1^-5-1,9-1 ^ 

K M -x(A,B) K qq (A,B) 



for all P = (A, B, x ) G V, with 

K(A,B) := [ K ql (A,B) •■• K q ^i(A, B) K qq (A, B) ] 
= -(/ + B qq X qq B qq )~ x B qq X qq \A\ q , 

where X qq is the unique positive definite solution to the discrete algebraic Riccati 
equation 



AqqXqqBq^I+BqqXqqBqq) 1 B^ q X qq A qq 



A T X A 



Xqq -1 = 0. 



(17) 



In words, control design strategy T applies the dcadbeat strategy to subsystems 
1 to q— 1 while, on subsystem q, it uses the same sub-controller as in the optimal 
controller for the plant 



x(k + l) = Ax(k) + Bu(k), 



(18) 
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with cost function 



k=l 



k=0 



where Q = diag(0, . . . , 0, /„ x „ ), the matrix A is defined as [A] q = [A] q and 
[A] z = for all z 7^ q, and furthermore, the matrix B is defined as B = 
diag(0, . . . , 0, B qq ). Note that T is indeed communication-less since K(A, B) de- 
fined above can be computed with the sole knowledge of the q th lower block of A 
and B. Because of the structure of matrices in A(S-p) and this characterization 
of T, we have 



J {A , B , Xo) (T(A,B)) = jV BtXo) + j[l Bxo) (K(A,B)), 
(1) - x^A T B- T B- 1 Ax , with 

An ■■■ Ai, q -! 



where J, 



(A,B,x ) 



A 



A 



9-1,1 



Ac 



lq-l,<jf-l 

and B = diag(-Bn, . . . , B q -i >q -i) and JW B x \ {K(A, B)) is the closed-loop 
cost for system (TT5)) . Since K(A,B) is the optimal controller for this cost, 



J, 



(2) 

(A,B,x 



(K(A, B)) = x^A T WAx , where 

W = diag(0, . . . , 0, X qq - X qq B qq {I + B^X^B^B^X,,). 
Using part 2 of Subsection 3.5.2 in |40j . we have the matrix inversion identity 
X - XY(I + ZXY)- 1 ZX = {X- 1 + YZ)-\ 

which results in 



Wo. 



x qq 



XqqB qq (yI + B qq X qq B qq ) B qq X qq 

f B qq B qq ) 



-l,p d t \-i 

qq ' 
-T D -1 



< B qq B qq . 

Note that X~ q x exists because X qq > I which follows from the discrete algebraic 
Riccati equation in (I17|) . This inequality implies that 

A T WA < A T (B^) T B^A 

where & = diag(0, . . . , 0, B qq ). Thus 

J ( a,b, X0 )(T(A B)) = j\ A \ B xo) + J$ iB>Xo) (K(A, B)) 
<J (A ,B, Xo) iX A {A 1 B)) 1 

for all P = (A, B, xo) € V such that the q th lower block of A is not zero, unless 
the J(a,b,x ) B)) = J(a,b.x ) (r A (^4, B)). Thus, control design method T 
dominates the deadbeat control design method T A . ■ 
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Remark 3.14. Consider the limited model information design problem given 
by the plant graph G-p in Figure\B(a), the control graph G'^ in Figure \^(b' ) , 
and the design graph G' c in Figure\^(c' ) . Theorems \3.10\ and \3.13\ show that the 
deadbeat control design strategy T A is the best control design strategy that one 
can propose based on the local model of subsystems and the plant graph, because 
the deadbeat control design strategy is the minimizer of the competitive ratio and 
it is undominated. 

Remark 3.15. It should be noted that, the proof of the "only if" part of the 
Theorem \3.13\ is constructive. We use this construction to build a control design 
strategy for the plant graphs with sinks in next subsection. 

3.2 Second case: plant graph G-p with at least one sink 

In this section, we consider the case where plant graph G-p has c > 1 sinks. 
Accordingly, its adjacency matrix S-p is of the form 



S v = 



' (Sv)n 


°(?-c)x(c) 




(Sv)22 



(19) 



where 



(Sv) 



ii 



(S 



and 



V)2\ 



(Svh 



(sv)n 

( S v)q-c,l 
{Sv)q-c+l,l 

( S v)q,l 
{Sv)q-c+l.q~c+l 





(Sv)l,q-c 

i s v)q—c,q~c 
{ S V)q-c+l,q-c 

{Sv)q,q-c 





• • • Mqq 

where we assume, without loss of generality, that the vertices are numbered 
such that the sinks are labeled q — c + 1, . . . , q. With this notation, let us now 
introduce the control design method T e defined by 

T e (A, B) = -diag( J B u 1 , . . . , B-_! Cig _ c , W q - C+1 (A, B), . . . , W q (A, B))A (20) 

for all (A, B) e A{S P ) x B(e), where 

Wi(A, B) = {i+ /;/,.\„/;„: n!,x„ (21) 

for all (7 — c + 1 < i < q and Xu is the unique positive definite solution of the 
discrete algebraic Riccati equation 



AjiXiiBn(I + B^XiiBu) 1 Bj i XiiAa — A^XuAu + Xu — / — 0. 



(22) 



The control design method T e applies the deadbeat strategy to every subsystem 
that is not a sink and, for every sink, applies the same optimal control law as if 
the node were decoupled from the rest of the graph. We will show that when the 



1G 



plant graph contains sinks, has, in worst case, the same competitive ratio 
as the deadbeat strategy. Unlike the deadbeat strategy, it has the additional 
property of being undominated by communication-less methods for plants in V 
when the plant graph G-p has sinks. 

Lemma 3.16. Let the plant graph G-p contain no isolated node, the design 
graph Gq be a totally disconnected graph with self-loops, and Gjc 2 G-p . Let T 
be a control design strategy in C. Suppose that there exist i and j ^ i such that 
(s'p)ij ^ and that node i is not a sink. The competitive ratio ofT is bounded 
only if 

Aj + BuTij {A, B) = 0, for all P = {A, B, x a ) e V. 
Proof: Sec Appendix lEl ■ 

Remark 3.17. Lemma \ 3.1(A shows that a necessary condition for a bounded 
competitive ratio is to decouple the nodes that are not sinks from the rest of the 
network. 

Now, we are ready to compute the competitive ratio of the newly defined 
control design strategy T e . This is done at first for the case that the control 
graph G/c is a complete graph. 

Theorem 3.18. Let the plant graph G-p contain no isolated node and at least 
one sink, and the control graph Gjc be a complete graph. Then the competitive 
ratio of the communication-less design method T e introduced in i20\) is 

r (T e ) = { 1 ' ^ ( Sv ^ n = and (^p) 22 = °j 

V ^ ' \ 1 + 1/e 2 , otherwise. 

Proof: Based on Theorem l3.4l we know that, for every plant P = (A, B, Xq) £ 

V 

2 

J {A ,B,x ){K*{A,B)) > T —^ x TA T B- T B- 1 Ax , (23) 

In addition, proceeding as in the proof of the "only if" part of the Theorem l3.13l 
we know that 

J(A,B, x »)(r A (A,B)) > J (AtBtXo) (T e (A,B)). (24) 
Plugging equation ([24| into equation ([23]) results in 
J(A,B,x )(T e {A,B)) 1 

-J L,,, R u < 1 + "a , VP = {A, B, Xq) e V. 

As a result, rp(T e ) < 1 + 1/e 2 . To show that this upper-bound is tight, we 
now exhibit plants for which it is attained. We use a different construction 
depending on matrices (Sp)n and (Sp) 22- If (Sp)u ^ 0, two situations can 
occur. 

Case 1: (S-p)n ^ and it is not diagonal. There exist 1 < i =/= j • < q — c such 
that (s-p)ij 7^ 0. In this case, choose indices i\ 6 I; and ji € 2j and define 
A = e^e^ and B = eL. Then, for xo = ej lt we find that 

J {A ,B, xo} (r & (A,B)) 1/6 2 1 

J ( a,b, xo) {K*(A,B)) 1/(1 + e 2 ) + e 2 
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because the control design T e acts like the deadbeat control design method on 
this plant. 

Case 2: (Sp)n ^ and it is diagonal. There exists 1 < i < q — c such that 
(s-p)u 7^ 0. Pick an index i\ £ 2^. In that case, consider A(r) = re^e^ and 
B = el. For Xq = , the optimal cost is 



tTr*,A,s n s\ Vr 4 + 2r 2 e 2 - 2r 2 + e 4 + 2e 2 + 1 + r 2 - e 2 - 1 
J W r),B, Xo ){K*(A(r),B)) = — , 

which results in 

,B,xo) 

(T®(A,B)) 1 , 1 
™oJ {A , B)Xo) (K*(A,B)) + e 2 ' 

Now suppose that (S-p)n = 0. Again, two different situations can occur. 
Case 3: (SV)n = and (675)22 7^ 0- There exists q — c + 1 < i < q such that 
(s-p)u 7^ 0. From the assumption that the plant graph contains no isolated node, 
we know that there must exist 1 < j < q — c such that (s-p)jj ^ 0. Accordingly, 
let us pick ii £li and ji £ Ij and consider the 2-parameter family of matrices 
A(r, s) in A(S-p) with all entries equal to zero except a^^, which is equal to r, 
and ajjji, which is equal to s. Let -B = el. For any initial condition xq, the 
corresponding closed-loop performance is 

J(A(r,s),B,x )(r e (A(r, s),B)) = p e xla{r, s)a(r, s) T x , 

where we have let a(r, s) = A(r, s)f and (3q is 



_ Vr 4 + 2r 2 e 2 - 2ar 2 + e 4 + 2e 2 + 1 + r 2 - e 2 - 1 
P* - 2-2^ ■ 

Besides, the optimal closed-loop performance can be computed as 

J(.A(r,s),B,x )(K*{A(r, s),B)) = /3 K ,Xoa(r, s)a{r, s) T x , 
where /3k* is 

e 2 s 2 + r 2 (l + e 2 ) - (e 2 + l) 2 + ^/c^cT 
PK* = 



Then, 



2e 2 (e 2 + l)(s 2 +r 2 ) 
c± = (eV + (r 2 ± 2r)(e 2 + 1) + (e 2 + l) 2 ). 



r P (r e ) > lim J (A(r,s),B,xo)F e (Mr,a),B)) 

~ r-t-oo.f-Kx) J(A(r :S ),B,x )( K *(A(r, s) , B)) 
1 



1 



c 2 



Case 4 : (S-p)n = and (575)22 = 0. Then, every matrix A £ A(S-p) has the 



form 











and, in particular, is nilpotent of degree 2; i.e., A 2 = 0. In this 





case, the Riccati equation yielding the optimal control gain K*(A,B) can be 
readily solved, and we hnd that K*(A, B) = -(I + B T B)- 1 B T A for all (A, B). 
As a result, K*(A,B) = ^(A^B) for all plant P = (A,B,x ) £ V (since 
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Wi(A, B) = (I + Bf i B li )~ 1 Bf i for all q - c + 1 < i < q), which implies that the 
competitive ratio of T against plants in V is equal to one. ■ 

In Theorem 13. 1 81 the control graph G/c is assumed to be a complete graph. 
We needed this assumption to calculate the cost of the optimal control design 
strategy K*{P) when (S-p)n = and (SV>)22 7^ which is not an easy task when 
the control graph Gjc is incomplete. However, more can be said if (Sp)u 7^ 0. 

Corollary 3.19. Let the plant graph Gp contain no isolated node and at least 
one sink and G/c 2 G-p . Then 



1, if (S-p)u = and (S v ) 2 2 = 0, 

1 + 1/e 2 , tf(Sp) 119 iO. 



Proof: According to Theorem 13. 181 for (S-p)u 7^ 0, we get 

(T®(A,B)) 
Tvy ' P S J (AtBtXo) (K*(P)) 

J (ABiXo) (T & (A,B)) 1 
-p7vJ(a,b, X0 )(K* c (A,B)) + e 2 ' 

Case 1: (S-p)n 7^ and it is not diagonal. For the special plant introduced in 
Case 1 in the proof of Theorem 13.181 we have J[A.B,e jl ){K}j(A 1 B)) = 
J(A,B,e jl )(K*(A,B,ej 1 )) since A = e^ej^ is a nilpotent matrix. The rest of 
the proof is similar to Case 1 in the proof of Theorem 13. 181 
Case 2: (S-p)n 7^ and it is diagonal. Note that, for the special plant intro- 
duced Case 2 in the proof of Theorem 13.181 we have 

_ Vr 4 + 2r 2 e 2 - 2r 2 + e 4 + 2e 2 + 1 + r 2 - e 2 - I 
K C\AB) - — A 

which shows Kq(A,B) € /C(5/c) and similar to the proof of Theorem 13.41 we 
get J {At B, eil ){Kc( A i B )) = J(A,B, eil )(K* (A,B e tl )). The rest of the proof is 
similar to Case 2 in the proof of Theorem 13.181 

Case 3: (S-p)n = and (S-p) 2 2 = 0. Then, every A e A(S-p) is nilpotent 
matrix which results in J P (K*(P)) = J P (K^,(A, B)). The rest of the proof is 
similar to Case 4 in the proof of Theorem 13.181 ■ 

Now that we have computed the competitive ratio of the control design 
strategy T in the presence of sinks, we present a theorem to show that the 
competitive ratio of any other communication-less control design strategy is 
lower-bounded by the competitive ratio of r e when the control graph G/c is 
a complete graph. Therefore, the control design strategy T e is a minimizer of 
the competitive ratio over the set of limited model information control design 
strategies. 

Theorem 3.20. Let the plant graph G-p contain no isolated node and at least 
one sink, the control graph Gx. be a complete graph, and the design graph Gc be 
a totally disconnected graph with self-loops. Then the competitive ratio of any 
control design strategy T <G C satisfies 

Mr) > 1 + 1/e 2 , 

if either (Sp)n is not diagonal or (575)22 7^ 0. 
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Proof: Case 1: (S-p)n 7^ and it is not diagonal. Then, there exist 
1 < *ij "Si o — c and i 7^ j such that (sp)ij 7^ 0. Choose indices i\ £ li and 
ji G Xj and consider the matrix A defined by A = e^ej^ and £> = e/. From 
Lemma 13.161 we know that a communication-less method V has a bounded 
competitive ratio only if T(A, B) = —B~ x A (because node i is a part of (SV>)ii 
and it is not a sink). Therefore 

J ( ^, ejl) (r(^,g)) 1 

for any such method. 

Case 2: (5*73)22 7^ 0. There thus exists q — c + 1 < i < q such that (s-p)u 7^ 0. 
Note that, there exists 1 < j < g — c such that (s-p)ij 7^ 0, since there is no 
isolated node in the plant graph. Choose indices i\ € Xi and j\ € Xj. Consider 
A defined as A = rei 1 e^ i + se^e^ and B = el. As indicated in the proof of 
Theorem 13.181 control design strategy T yields the globally optimal controller 
with limited model information for plants in this family. Hence, we know that 
r-p(r) > 1 + 1/e 2 for every communication-less strategy T. ■ 

In Theorem 13.201 we assume the control graph G/c is a complete graph. In 
the next corollary, we generalize this result to the case where Gx. is a supergraph 
of G-p when (SV>)n i s n °t diagonal. 

Corollary 3.21. Let the plant graph G-p contain no isolated node and at least 
one sink, the design graph Gq be a totally disconnected graph with self-loops, 
and G/c 3 G-p . Then the competitive ratio of any control design strategy T G C 
satisfies 

r v (T) > 1 + 1/e 2 , 

if (S-p)n is not diagonal. 

Proof: Considering that for the nilpotent matrix A = e.^e^, we get 
J{A,B,e jl )i.K*{A,B,e h )) = J (A,B, e j AK c( A > - B ))i the rest of the Proof is similar 
to Case 1 in the proof of Theorem 13.201 ■ 



Remark 3.22. Combining Theorems \3. 18\ and \3.20\ imvlies that if either (S-p)n 
is not diagonal or (<SV>)22 7^ 0, control design method T e exhibits the same 
competitive ratio as the deadbeat control strategy, which is the smallest ratio 
achievable by a communication-less control method. Therefore, it is a solution 
to problem U0\) . Furthermore, if (Sp)n and (<SV>)22 ore. both zero, then r e is 
equal to K* , which shows that r e is a solution to problem \10\) . in this case too. 

Remark 3.23. The case where (S'p)ii is diagonal and {Sp)22 = is still open. 

The next theorem shows that T is a more desirable control design method 
than the deadbeat control design strategy when the plant graph Gp has sinks, 
since it is then undominatcd by communication-less design methods. 

Theorem 3.24. Let the plant graph Gp contain no isolated node and at least 
one sink, the design graph Gc be a totally disconnected graph with self-loops, 
and G/c 3 Gp. The control design method T is undominated by any control 
design method feC. 
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Proof: Sec Appendix IF1 



Remark 3.25. Consider the limited model information design problem given by 
the plant graph G' v in Figure\^(a' ) , the control graph G' K in Figure\^(b' ) , and the 
design graph G' c in Figure\^(c' ) . Theorems 1 3. 181 \3. 2(A and \3.2l\ together show 
that, the control design strategy V is the best control design strategy that one 
can propose based on the local model information and the plant graph, because 
the control design strategy F e is a minimizer of the competitive ratio and it is 
undominated. 

Remark 3.26. For general weight matrices Q and R appearing in the perfor- 
mance cost, the competitive ratio of both the deadbeat control design strategy 
r A and the control design strategy F e is 1 + <j(R) / (g_(Q)e 2 ) . In particular, 
the competitive ratio has a limit equal to one as d % {R)/g_{Q) goes to zero. We 
thus recover the well-known observation (e.g., \41V that, for discrete-time lin- 
ear time-invariant systems, the optimal linear quadratic regulator approaches 
the deadbeat controller in the limit of "cheap control". 

4 Design Graph Influence on Achievable Perfor- 
mance 

In the previous section, we have shown that communicat-ion-less control design 
methods (i.e., Gc is totally disconnected with self- loops) have intrinsic perfor- 
mance limitations, and we have characterized minimal elements for both the 
competitive ratio and domination metrics. A natural question is "given plant 
graph G-p, which design graph Gc is necessary to ensure the existence of F G C 
with better competitive ratio than F A and F e ?". We tackle this question in 
this section. 

Theorem 4.1. Let the plant graph G-p and the design graph Gc be given and 
G/c 12 G-p. If one of the following conditions is satisfied then rp(T) > 1 + 1/e 2 
for all r G C: 

(a) Gp contains the path k — > i — > j with distinct nodes i, j, and k while 
{j,i)iE c . 

(b) There exist i ^ j such that ni > 2 and G Ep while (j, i) Eq- 

Proof: We prove the case when condition (a) holds. The proof for condi- 
tion (b) is similar. 

Let i, j, and k be three distinct nodes such that (sp)ik ^ and (s-p)ji 7^ 
(i.e., the path k — > i — > j is contained in the plant graph Gp). Let us pick 
i\ G 2i, j\ G Tj and k\ G and consider the 2-parameter family of matrices 
A(r, s) in A(Sp) with all entries equal to zero except , which is equal to r, 
and aj-Li-L, which is equal to s. Let B = el and let L G C be a limited model 
information with design graph Gc ■ For xq — , we have 

J(A {r , s ),B,e kl ) (L(A(r, s), B)) > (r + e lllkl (A, B)) 2 [7?^ + (s + e lnil (A, B)f] 
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where 7i 1 fc 1 cannot be a function of s because (J, i) £ Eq- Note that, irrespective 
of the choice of (A, B), we have 

r (V(A( ^ n» . M^feM!!! 
J(A(r,s),B,e kl ){r{A(r, S), B)) > ' 

The cost of the deadbeat control design on this plant satisfies 

""A/ Af„ „\ D \\ 2 / 2 



and thus 



J { A(r,s h B,e kl} (T*(A(r,s),B)) = r 2 /e' 
J P (T(A,B)) 



r-p(r) = sup 



pS Jp(K*(P)) 

' J P (T(A,B)) J P (r A (A,B)) 
J P (T*(A,B)) Jp{K*{P)) 
Jp{T{A,B)) 



sup 

Per 



(25) 



> sup 

Pev 

> lim 



P ^ j P (rA(A,i?))' 

e 2 (r + e 7 i lfel (AB)) 2 s 2 



s— ¥qg 



(1 + e 2 )r 2 



This shows that rp(T) is unbounded unless r + eji 1 k 1 (A(r, s),B) =0 for all r, s. 
Now consider the 1-paramcter family of matrices A(r) with all entries equal to 
zero except a^kii which is equal to r. Because of (j, i) £ Eq, we know that 
T z (A{r),B) = T z (A(r,s),B) for all zel,. Thus 

^ W ,B, efcl )(r(A(r),B))>r 2 /e 2 . 



On the other hand, similar to the proof of Theorem 13.41 we can compute the 
optimal controller for systems in this 1— parameter family and find 

J ( A(r),i^j(in^W,B,e fel )) = J(A(r),B,e kl )(K* c (A(r),B)) 

= r 2 /(l + e 2 ), 

As a result, we get 

r 2 /e 2 1 

which concludes the proof for this case. ■ 



Remark 4.2. Consider the limited model information design problem given by 
the plant graph G-p in Figure fj|(a ), the control graph G'^ in Figure W(b' ), and 
the design graph Gq in Figure\B(c). Theorem ^. 1\ shows that, because the plant 
graph Gp contains the path 3 — > 2 — > 1 but the design graph Gc does not contain 
1 — > 2, the competitive ratio of any control design strategy T £ C would be greater 
than or equal to 1 + 1/e 2 - 

Corollary 4.3. Let both the plant graph Gp and the control graph Gjc be com- 
plete graphs. If the design graph Gc is not equal to Gp, then rp(T) > 1 + 1/e 2 
for all r G C. 
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Proof: The proof is a direct application of Theorem 14.11 with condition (a) 
fulfilled. ■ 

Remark 4.4. Corollary \4-S\ shows that, when Gp is a complete graph, achiev- 
ing a better competitive ratio than the deadbeat design strategy requires each 
subsystem to have full knowledge of the plant model when constructing each 
subcontroller. 



5 Extensions to Under- Actuated Sinks 



In the previous sections, we gave an explicit solution to the problem in (fTU)) 
under the assumption that all the subsystems are fully-actuated; i.e., all the 
matrices B £ B(e) are square invertible matrices. Note that this assumption 
stems from the fact that the subsystems that are not sinks in the plant graph are 
required to decouple themselves from the rest of the plant to avoid influencing 
highly sensitive (and potentially hard to control) subsystems in order to keep 
the competitive ratio finite (see Lemma l3.16p . Therefore, we assume these sub- 
systems are fully-actuated to easily decouple them from the rest of the system. 
As a future direction for improvement, one can try to replace this assumption 
with other conditions (e.g., geometric conditions) to ensure that the subsystems 
can decouple themselves. From the same argument, it should be expected that 
the assumption of a square invertible B-matrix is dispensable for sink nodes. In 
this section, we briefly discuss an extension of our results to the slightly more 
general, but still restricted, class of plants whose sinks are under- actuated. 

Consider the limited model information control design problem given with 
the plant graph Gp, the control graph Gjc, and the design graph Gc given in 
Figure [3J The state space representation of the system is given as 



where 



x 2 (k 



A 



A 



x x {k) 
x 2 {k) 



A n 
A21 A22 



D 



D 



B n 




wi(fc) 
u 2 {k) 



B22 



with x x {k) e R n \ x 2 (k) € R™ 2 , u^k) £ R™ 1 , and u 2 (k) € R 1 ™ 2 for some given 
integers n\ > 1, n 2 > m 2 > 1. Thus, for the second subsystem the matrix 
B22 € R™ 2 *™ 2 is a non-square matrix, and as a result the second subsystem is 
an under-actuated subsystem. Let us assume that the matrices A21, A22, B22 
satisfy the "matching condition"; i.e., the pair (^22,-622) is controllable and 
span(A2i) C span(i?22) [H]. Besides, assume that for all matrices B, we have 
£.(B) > e for some e > 0. For this case, we have 

T e {A,B) = -diag(B£i\W 2 (A 22 ,.B 2 2))A 



where W / 2(A 2 2, B22) is defined in (f2"Tj) . Note that we do not require the matrix 
B 22 to be square invertible. Under some additional conditions and following 
a similar approach as above, it can be shown that the control design strategy 
r becomes an undominated minimizer of the competitive ratio over the set of 
limited model information control design strategies. This result can be general- 
ized to cases with higher number of subsystems as long as the sinks in the plant 
graph G-p are the only under-actuated subsystems [43j . 
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(a) G p (b) G K (c) G c 



Figure 3: Plant graph G-p, control graph G/c, and design graph Gc used to 
illustrate an extension to under-actuated systems. 

6 Conclusion 

We presented a framework for the study of control design under limited model 
information, and investigated the connection between the quality of controllers 
produced by a design method and the amount of plant model information avail- 
able to it. We showed that the best performance achievable by a limited model 
information control design method crucially depends on the structure of the 
plant graph and, thus, that giving the designer access to this graph, even with- 
out a detailed model of all plant subsystems, results in superior design, in the 
sense of domination. Possible future work will focus on extending the present 
framework to dynamic controllers and/or where disturbances are present. 

References 

[1] F. Farokhi, C. Langbort, and K. H. Johansson, "Control design with limited 
model information," in American Control Conference, Proceedings of the, 
pp. 4697 - 4704, 2011. 

[2] F. Giulictti, L. Pollini, and M. Innocenti, "Autonomous formation flight," 
Control Systems Magazine, IEEE, vol. 20, no. 6, pp. 34 - 44, 2000. 

[3] V. Kapha, A. G. Sparks, J. M. Buffington, and Q. Yan, "Spacecraft for- 
mation flying: dynamics and control," in American Control Conference, 
Proceedings of the, vol. 6, pp. 4137 - 4141, 1999. 

[4] D. Swaroop and J. K. Hedrick, "Constant spacing strategies for platooning 
in automated highway systems," Journal of Dynamic Systems, Measure- 
ment, and Control, vol. 121, no. 3, pp. 462 - 470, 1999. 

[5] R. R. Ncgenborn, Z. Lukszo, and H. Hellcndoorn, eds., Intelligent Infras- 
tructures, vol. 42. Springer, 2010. 

[6] S. M. Joshi, Control of large flexible space structures. Springer- Verlag, 1989. 

[7] W. B. Dunbar, "Distributed receding horizon control of dynamically 
coupled nonlinear systems," Automatic Control, IEEE Transactions on, 
vol. 52, no. 7, pp. 1249 - 1263, 2007. 

[8] W. Levine, T. Johnson, and M. Athans, "Optimal limited state variable 
feedback controllers for linear systems," Automatic Control, IEEE Trans- 
actions on, vol. 16, no. 6, pp. 785 - 793, 1971. 

[9] C. Wenk and C. Knapp, "Parameter optimization in linear systems with 
arbitrarily constrained controller structure," Automatic Control, IEEE 
Transactions on, vol. 25, no. 3, pp. 496 - 500, 1980. 



24 



[10] T. Soderstrom, "On some algorithms for design of optimal constrained reg- 
ulators," Automatic Control, IEEE Transactions on, vol. 23, no. 6, pp. 1100 

- 1101, 1978. 

[11] S.-H. Wang and E. Davison, "On the stabilization of decentralized control 
systems," Automatic Control, IEEE Transactions on, vol. 18, no. 5, pp. 473 

- 478, 1973. 

[12] G. Ayres de Castro and F. Paganini, "Control of distributed arrays with 
recursive information flow: some case studies," in Decision and Control, 
Proceedings of the 38th IEEE Conference on, vol. 1, pp. 191 - 196, 1999. 

[13] B. Bamich, F. Paganini, and M. A. Dahleh, "Distributed control of spatially 
invariant systems," Automatic Control, IEEE Transactions on, vol. 47, 
no. 7, pp. 1091 - 1107, 2002. 

[14] B.-D. Chen and S. Lall, "Dissipation inequalities for distributed systems on 
graphs," in Decision and Control, Proceedings of the 42nd IEEE Conference 
on, vol. 3, pp. 3084 - 3090, 2003. 

[15] Z. Hu, "Decentralized stabilization of large scale interconnected systems 
with delays," Automatic Control, IEEE Transactions on, vol. 39, no. 1, 
pp. 180 - 182, 1994. 

[16] G. Scorletti and G. Due, "An LMI approach to decentralized control," 
International Journal of Control, vol. 74, no. 3, pp. 211 - 224, 2001. 

[17] M. Rotkowitz and S. Lall, "A characterization of convex problems in de- 
centralized control," Automatic Control, IEEE Transactions on, vol. 51, 
no. 2, pp. 274 - 286, 2006. 

[18] P. G. Voulgaris, "Optimal control of systems with delayed observation shar- 
ing patterns via input-output methods," Systems & Control Letters, vol. 50, 
no. 1, pp. 51 - 64, 2003. 

[19] J. C. Doyle, "Analysis of feedback systems with structured uncertain- 
ties," Control Theory and Applications, IEE Proceedings D, vol. 129, no. 6, 
pp. 242 - 250, 1982. 

[20] G. Zames, "Feedback and optimal sensitivity: Model reference transfor- 
mations, multiplicative seminorms, and approximate inverses," Automatic 
Control, IEEE Transactions on, vol. 26, no. 2, pp. 301 - 320, 1981. 

[21] J. A. Ball and N. Cohen, "Sensitivity minimization in an Hoc norm: 
parametrization of all suboptimal solutions," International Journal of Con- 
trol, vol. 46, no. 3, pp. 785 - 816, 1987. 

[22] K. Zhou and J. C. Doyle, Essentials of robust control. Prentice Hall, 1998. 

[23] A. Ando and F. M. Fisher, "Near-dccomposability, partition and aggrega- 
tion, and the relevance of stability discussions," International Economic 
Review, vol. 4, no. 1, pp. 53 - 67, 1963. 



25 



[24] S. Sethi and Q. Zhang, "Near optimization of dynamic systems by decompo- 
sition and aggregation," Journal of Optimization Theory and Applications, 
vol. 99, no. 1, pp. 1 - 22, 1998. 

[25] V. G. Gajtsgori and A. A. Pervozvanski, "Perturbation method in the 
optimal control problems," Systems Science, vol. 5, pp. 91 - 102, 1979. 

[26] M. E. Sezer and D. D. Siljak, "Nested e-decompositions and clustering of 
complex systems," Automatica, vol. 22, no. 3, pp. 321 - 331, 1986. 

[27] C. Langbort and J.-C. Dclvenne, "Distributed design methods for linear 
quadratic control and their limitations," Automatic Control, IEEE Trans- 
actions on, vol. 55, no. 9, pp. 2085 - 2093, 2010. 

[28] M. Baughman, S. Siddiqi, and J. Zarnikau, "Advanced pricing in electrical 
systems, i. theory," Power Systems, IEEE Transactions on, vol. 12, no. 1, 
pp. 489 - 495, 1997. 

[29] A. Berger and F. Schweppe, "Real time pricing to assist in load frequency 
control," Power Systems, IEEE Transactions on, vol. 4, no. 3, pp. 920 - 
926, 1989. 

[30] H.-P. Chao and S. Peck, "A market mechanism for electric power transmis- 
sion," Journal of Regulatory Economics, vol. 10, pp. 25-59, 1996. 

[31] A. Botterud, M. Ilic, and I. Wangensteen, "Optimal investments in power 
generation under centralized and decentralized decision making," Power 
Systems, IEEE Transactions on, vol. 20, no. 1, pp. 254 - 263, 2005. 

[32] M. Braun, D. Rivera, M. Flores, W. Carlyle, and K. Kempf, "A model pre- 
dictive control framework for robust management of multi-product, multi- 
echelon demand networks," Annual Reviews in Control, vol. 27, no. 2, 
pp. 229 - 245, 2003. 

[33] X.-B. Chen and S. S. Stankovic, "Decomposition and decentralized control 
of systems with multi-overlapping structure," Automatica, vol. 41, no. 10, 
pp. 1765 - 1772, 2005. 

[34] H. Zeynelgil, A. Demiroren, and N. Scngor, "The application of ann tech- 
nique to automatic generation control for multi-area power system," In- 
ternational Journal of Electrical Power & Energy Systems, vol. 24, no. 5, 
pp. 345 - 354, 2002. 

[35] T. Vicsek, A. Czirok, E. Ben- Jacob, I. Cohen, and O. Shochet, "Novel type 
of phase transition in a system of self-driven particles," Physical Review 
Letters, vol. 75, pp. 1226-1229, 1995. 

[36] A. Jadbabaie, J. Lin, and A. S. Morse, "Coordination of groups of mo- 
bile autonomous agents using nearest neighbor rules," Automatic Control, 
IEEE Transactions on, vol. 48, no. 6, pp. 988 - 1001, 2003. 

[37] A. Emami-Naeini and G. Franklin, "Deadbeat control and tracking of 
discrete-time systems," Automatic Control, IEEE Transactions on, vol. 27, 
no. 1, pp. 176 - 181, 1982. 



26 



[38] W. Levine and M. Athans, "On the determination of the optimal constant 
output feedback gains for linear multivariable systems," Automatic Control, 
IEEE Transactions on, vol. 15, no. 1, pp. 44 - 48, 1970. 

[39] D. B. West, Introduction to Graph Theory. Prentice Hall, 2001. 

[40] H. Liitkepohl, Handbook of matrices. Wiley, 1996. 

[41] J. O'Reilly, "The discrete linear time invariant time-optimal control 
problem-an overview," Automatica, vol. 17, no. 2, pp. 363 - 370, 1981. 

[42] D. D. Siljak, Decentralized control of complex systems. No. 184, Academic 
Press, 1991. 

[43] F. Farokhi and K. H. Johansson, "Dynamic control design based on lim- 
ited model information," in Communication, Control, and Computing, 49th 
Annual Allerton Conference on, pp. 1576 - 1583, 2011. 

[44] N. Komaroff, "Iterative matrix bounds and computational solutions to the 
discrete algebraic Riccati equation," Automatic Control, IEEE Transac- 
tions on, vol. 39, no. 8, pp. 1676 - 1678, 1994. 

A Proof of Lemma 13.31 

For any plant P = (A,B,xq) £ V, the optimal controller K*(P) exists (be- 
cause the plant is controllable since B is invcrtiblc by assumption) and can be 
computed using the unique positive definite solution to the discrete algebraic 
Riccati equation 

X = A T XA - A T XB(I + B T XB)- 1 B T XA + I. (26) 

The corresponding cost is Jp(K*(A, B)) = Xq(X — I)xq. Inserting the product 
BB^ 1 before every matrix A and B~ T B T after every matrix A T in (|2"6"|) results 
in 

X-I = A T B- T B T XBB- 1 A 

- A T B- T B T XB(I + B T XB)- 1 B T XBB- 1 A. 

Naming B T XB as Y simplifies ([27| into 

X - I = A T B~ T [Y -Y(I + Y)- 1 Y]B- 1 A. (28) 

Note that Y is a positive definite matrix because X is positive definite and B 
is full rank. Let us denote the right-hand side of U2SJI by A T B^ T g(Y)B^ 1 A. 
Then we can make the following two claims regarding the rational function <?(•). 

Claim 1: The function y i— > g(y) = y/(l + y) is a monotonically increasing 
over R+. 

Claim 2: Let Y £ 52, and D, T be diagonal and unitary matrices, respec- 
tively, such that Y = T T DT. Then g(Y) = T T 6ia,g(g{d ll ))T , where d it arc the 
diagonal elements of D (and the eigenvalues of Y). 
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Claim 1 is proved by computing the derivative of g over R + , while Claim 2 
follows from the fact that all matrices involved in the computation of g(Y) can 
be diagonalized in the same basis yielding 

g{Y) =Y -Y(I + Y)' 1 Y 

= T T DT - T T DT(I + T T DT)~ l T T DT 
= T T (D - D(I + L>)" 1 J D)T 
= T T g(D)T. 

Using these two claims, we find that, for all Y with eigenvalues denoted by 
A 1 (y),...,A„(F) 

X - I = A 7 'B' 7 'g(Y)B~ 1 A 

= A T B- T T T diag(g(X l (Y)))TB- 1 A (29) 
> (t,WY)))A T B- T B- 1 A, 

where X(Y) is a positive number because matrix Y is a positive definite matrix. 
Now, according to [33] . 

X(X) > X(A 7 (I + BB T )~ 1 A + 1) > Y^^y + 1. (30) 

Using |J3DJ) in inequality X(Y) > a 2 (B)X(X) gives 

and, because of the claim 1 and the inequality in pip , we will have 

2. 2 {B)[a 2 {A)+a 2 {B) + l} 



9(k(Y)) > i + a 2 (B) + a 2 (B)\a 2 (A)+a 2 (B) + l] 
<L 2 (B) 



(32) 



> 



a 2 (B) + l 
Combining (|29)1 and (|32p results in 



X _ / > g?g) . A T B- T B- 1 A 1 



a 2 (B) + l 
and, therefore 

Jp(K*(A,B))=x 7 (X-I)x q 



> ( : ) x T Q {A T B- T B^A)x Q 



a 2 (B) + l 
g_ 2 {B) + l 



J P (T*(A,B)). 
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B Proof of Lemma 13.81 



Let r G C and assume that the implication does not hold, i.e., that there exists 
a matrix A and indices i, j with £q G Xj such that a^j = for all t G Xj 
but 7^ j(A, 5) 7^ 0. Consider matrix A such that At = At for all I G Xj and 
v4 2 = for all z ^ Xj- Based on the definition of limited- model-information 
control design methods, we know that Tg(A,B) = Te(A,B) for all I G 2$ and 
r z (A,B) = for all z ^ I, (because = T z (0,B) for all z I, and, 

as shown in [57], it is necessary that T(0,B) = for a finite competitive ratio). 
For a: = , we have 

J ( A,B, ej )(nAB)) > £ 7 «(A£) 2 = E %'(A5) 2 

> 7 ^(A,B) 2 >0. 

Using (j2"5j) . we get 

MT) > 

since J ( ^ ej) (r A (^,i?)) = 0. 

C Proof of Lemma 13.9 

Clearly, it is enough to prove inequality (|16[) for control design methods with a 
finite competitive ratio. 

We proceed in three steps. First, using Lemma 13. 81 we characterize the 
design strategics leading to a finite competitive ratio. Then, we argue that 
the controllers produced by such strategies must be stabilizing for all plants, 
and use the fact that every closed-loop characteristic polynomial is Schur to 
construct a sequence of real numbers with specific properties for each control 
design strategy. We then use this sequence to construct a sequence of plants 
allowing us to lower bound the competitive ratio of each control design strategy. 

Let G-p have a loop and r G C have finite competitive ratio. Without loss 
of generality, let us assume that the nodes of graph G-p are numbered such 
that it admits the following loop of length t. 1 —> 2 ^ — > 1. Let us 

choose indices i± G Xl, ii G X2, it £ 1( and consider the one-parameter 
family of matrices {A(r)} defined by a^^ir) = r, ai 3 i 2 (r) = r, . . ., a,i e i e i (r) — 
r, CLi-Litir) — r, and all other entries equal to zero, for all r. Let B = el. 
Because of Lemma l3~81 the controller gain entries Jj 2 n (A(r), B) for all j'2 G I2, 
Ijsii (^( r )i ^0 f° r a ^ J3 G X3, . . ., r )j e i l _ 1 (A(r), B) for all ji G It , Ijiie 

(A(r),B) 

for all ji G T\ can be non-zero, but all other entries of the controller gain 
T(A(r), B) are zero for all r. As a result, the characteristic polynomial of matrix 
A{r) + BT(A(r), B) can be computed as: 

\ n ~ e {\ e -(-lY (r + e ll2ll (A(r),B))(r + e li3i2 (A(r), B)) 
x • • • x (r + (A(r), B))(r + (A(r),B))). 

Now, note that because T has a bounded competitive ratio against V by as- 
sumption, this polynomial should be stable for all r. (Indeed, T can have a 



— — = 00 

J^B.e^rHAB)) 

This proves the claim by contrapositive. 
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finite competitive ratio only if A + BT(A,B) is stable for all matrices A, oth- 
erwise it would yield an infinite cost for some plants while the corresponding 
optimal cost remains bounded since the pair (A, B) is controllable for all plant 
in V). As a result, we must have 

|(r + e ll2ll (A(r),B)) • • • (r + e 7ilk (A(r), B))\ 
= \r + ey i2il (A(r),B)\---\r + e 7ilil (A(r),B)\ < 1 

for all r. Let {rz\^L\ be a sequence of real numbers with the property that r z 
goes to infinity as z goes to infinity. From (|33[) . we know that there exists an 
index m such that 

ViV, 3z > N such that \r z + e 7 ^ ei ^ (A(r 2 ), B)\ < 1, (34) 

where "©" designated addition modulo £; i.e., i®j = (i+j) — where 
[;i'J = max{y G Z|y < x} for all Indeed, if this is not the case, it is true 

that 

Vm, 3N m such that \r z + ej immim (A(r z ), B)\ > 1, 

Vz > N m . 

Then, for all z > max m N m and all m, 

\rz + e-/ im9lim (A(r z ),B)\ > 1 

which contradicts (j33|) . Without loss of generality (since this just amounts to 
renumbering the nodes in the plant graph), we assume that fh = 1. Using (|34[) . 
we can then construct a subsequence {r^j} of {r z } with the property that 

\r^ z ) + £"ti2ii( A ( r <t>(z)), B )\ < 1 for all z. 

Now introduce the sequence of matrices {A(z)}'^ =1 defined by Ai 2 i t (z) = 

for all z and every other row equal to zero. For large enough z (and hence, large 

enough 7>( z) ), we get 

J(AM,B, ei jnMz),B)) > ll2ll (A{z),B) 2 

= llllA A (. r <t>(z)):B) 2 

(k> (2) l-i) 2 



and thus 



> 



J (A(z) , B , eii) (T(A(z),B)) (Ir^l-l) 2 /^ 



JiAi^B^iK^AizlB^))'- rj w /(l + ea) ' 
This, in particular, implies that 

r-p(I ) > hm -i — - - — > 1 + 1/e . 

" J ( A(,), B , eil )(if*(^)»-B,e <1 )) " 

Note that ^4(z) is a nilpotent matrix for all z, and thus 

^W,B,e jl )(^*(^W.-B.Cii)) = ^.B.e^C^W^)) 

similar to the proof of Theorem 13.41 and therefore 

^A Wl B ieil )(^c»),B)) = rj w /(l + e 2 ) 
using the unique positive-definite solution of discrete algebraic Riccati equation 
in (USD. 
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D Proof of Lemma 13.121 



We prove that if there is no sink in the plant graph (i.e., according to [39j . if 
Vj3fc, k j, such that (s-p)kj 7^ 0) then the deadbeat control design method 
is undominated. For proving this claim, we are going to prove that for any 
control design T € C\{ T A }, there exists a plant P = (A,B 7 xo) G V such 
that J P (T(A,B)) > J P (T A (A,B)) = x%[A T B~ T B" 1 A]x . We will proceed in 
several steps, which require us to partition the set of limited model information 
control design methods C as follows 

C = C c U Wi U W 2 u {r A }, 

where 

£:= {re C\3Aj : R" jXn x R" jX " J ' -> R n i Xn i , 
[T(A, B)]j = Aj([A]j,Bjj)[A]j, for all 3 = 1, ■ • • , g}, 

Wi := {r G £|3j, i 7^ j and A tj G E niX "^ nonzero s.t. 
7 + 5 M A 4 ([0 ••• .1,, ()•••(). B u ) £ 0}, 

and 

w 2 :={re£\>Vi|aie{i,"- ,q},[A]i gR" <x ", with 

appropriate structure s.t. 7 + BaAi([A]i, Bu) 7^ 0}. 

In words, C is the set of all control design methods for which sub-controller Kj 
can be written as a linear combination of vectors in {Ai, i G X,} for all j. Sets 
Wi and W2 are subsets of C which put further constraints on map T. Using 
different lower bounds on closed-loop performance in each case, we show that 
T A is undominated by control strategies in each of C c , Wi, and W^- 

First, we prove that the deadbeat control design method is undominated by 
control design strategies in C c . Let r G C c and let j be such that 3ji G Ij 
which Tj 1 (A, B) T cannot be written as a linear combination of vectors in the 
set {Af ,Vi G Ij} for some matrix A and matrix B. Let af = A{ for all i G Ij 
and consider matrix A such that the row Ai = a[ for all i G Ij and Ai = for 
all i G I]. If T(0, B) 7^ 0, then T cannot dominate T A (since T A (0, S) = for 
all xq) and, thus, there is no loss of generality in assuming that r(0, B) = for 
all xq, and, in turn that Ti(A, B) = for all i G X?. Let us also denote T(A, B) 
by K and r t (A, B) = T t (A, B) by Kf for all i G Ij. For all x , 

J(A,B,x )(r(^, B)) > xl\K T K + (A + BK) T (A + BK)]x , 

and 

(r A (A, b)) 

>xl[A T {I-B- T B- 1 )A + A T BK (35) 
+K T B T A + K T (I + B T B)K}xq. 

We know that null(yl) = spa,n{Af , Vi G Ij} 7^ {0}, because rij < n. On the 
other hand, we know that there exists an j\ G Ij such that Kj 1 f£ span{A^, Vi G 
Ij} which shows that 

span{Af ,Vi G X,} £ span{Af ,Vi G 2j} + span{i^f, Vi G Ij}, 
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Thus, we can choose an initial condition xq £ null(A) such that Kxq 7^ 0. Using 
this xq in (|35[) results in 

J { a,b, X0 )(T(A,B)) - J {A! B tXo) (T A (A,B)) > x^[K T (I + B T B)K]x > 0. (36) 

Therefore, the control design strategies in C c cannot dominate the deadbeat 
control design strategy L A . 

Second, we prove that the deadbeat control design strategy is undominated 
by control design methods in Wi. Let T £ Wi and let j be such that (/ + 
Bu Aj([0 • • • Aij • • ■ 0] , Ba)) 7^ for some i 7^ j. It means that there exists 
at least i\ £ Xj and j\ £ Ij such that <i; Ul 7^ and a,i 1 j 1 + bi 1 i 1 ji 1 j 1 (A, B) 7^ 0. 
Using the structure matrix, we know that there exits a I 7^ i such that (s-p)u 7^ 
0. Choose an index l\ € I(. Consider the matrix A defined by [A]i = [A]i, 
a fiii = r an d all other entries equal to zero. Then, [T(A, B)]i = Ai([A]i, Ba)[A]i, 
\T(A, B)]i = A e ([A] £ ,B a )[A] £ (because L £ £), and [T(A,B)] Z = for all 
z + i,t Denote T(A, B) by K. We have 

J(a,b, X0 ) (T(A, B)) > Xq [(A + BK) T K T K{A + BK) 

+((A + BK) 2 ) T (A + BK) 2 ]xq. 

Using xq = ej t results in 

J{i, B , ejl )(r(AB)) - J^B, ejl) (r A (A,B)) > 

[^u + ( r + b £l£l k £lil ) 2 }(a iin + b lrll h hn ) 2 

Note that, irrespective of the choice of the controller gain kt^, 
kl n + (r + h lh k tli ,f > r 2 /(l + b 2 £l£l ), 

and as a result, 

lim +(r + b lltl k tlil ) 2 ] (a idl + b ilh k njl ) 2 = 00, 

because a,i 1 j 1 +bi 1 i 1 ki 1 j 1 7^ 0. Hence, we can always construct A with appropriate 
choice of index £ and a scalar r large enough to make the right hand side of the 
expression (|37|) positive. As a result, L € Wi cannot dominate L A . 

Third, we prove that the deadbeat control design strategy is undominated 
by control design methods in W^- Let L £ W2 and index i and vector [A]i be 
such that / + Aj([A]i, Bu) 7^ 0. Thus we know that there exists at least i\ £ Z$ 
such that A ix 7^ and A il + b ilil T il (A, B) 7^ 0. Based on the structure matrix 
we know that there exits I 7^ i such that (s-p)u 7^ 0. Choose an index £\ £ Xg. 
Consider the matrix A defined by [A]i = [A]i and = r and all other entries 
of A equal to zero. Then [A], + B rl [T(A,B)] l = (I + BuAiQA]i, Ba))[A]i and 
[A]j + Bjj[T(A, B)]j = for all j ^ i (and, in particular, j = £ since T does not 
belong to W\). Again, K will stand for T(A, B). We have 

K T K + (A + BK) T K T K(A + BK) - A T B~ T B^ 1 A 
> {A ll +b llll T ll (A,B)) T {A ll +b llli r il {A 7 B))x 
r 2 lbU - £ A T z A z jb 2 zz , 



b 2 

zEXi zz 



(37) 
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and hence, since A i± + b^T^ (A, B) ^ 0, we can choose r large enough to 
ensure that this matrix has a strictly positive eigenvalue. Thus, the control 
design strategy T G W 2 cannot dominate T A . 



E Proof of Lemma 13.161 

The proof is by contrapositive. Let T be communication-less and assume that 
there exist matrices A and B and indices i\ G Ti and j\ G Ij such that ai 1 j 1 + 
bi 1 i 1 ji 1 j 1 (A, B) ^ 0. Choose an index fci G T k . Consider the one-parameter 
family of matrices A(r) defined by — [A]i, a kl i 1 = r, and all other 

entries of A{r) being equal to zero for all r. Wc know that [T(A(r),B)]i = 
[T(A, B))i and T%{A(r),B) = j kh (r)e£ for all k G l k (because of Lemma [3T8)l . 
[r(j4(r), B)] z = for all z ^ i,k. For xo = ej 1 , we have 

J(A(r),B,e 31 ){T{A{r),B)) > (a ilh +bi lll "/ ilJ1 {A,B)) 2 

x [7fcmM 2 + (r + b klkllklll {r)) 2 }. 

The minimum value of function y n- [y 2 + (r + b klkl y) 2 ) is r 2 / (1 + b 2 . k ). Hence, 
irrespective of function 7k 1 i 1 , 

^(r) I B,«, 1 )(T(^(r) ) B)) > {a. ll3l +b lrllllin {A,B)) 2 r 2 /{l + b 2 iki ). 

Note that the term (a,i 1 j 1 + &j 1 i 1 7i 1 j 1 B)) 2 is independent from r because T 
is communication-less. In addition, 

= E f 1 = E 

for all r and, thus, J(A{r) b e- )(T A (A(r), B)) is also independent from r. Then, 
proceeding as in we deduce that 

Mr) > 7 ( 9 flnJ : +b ' 1Il7 ' 1J \ (A :^ 2 N . . lim r 2 . 

(l + ^ lfcl )-/(A W , B)e , 1 )(r A (A(r) J B))^oc 

Since (a-i 1 j 1 + bi 1 i 1 ^/i 1 j 1 (A, B)) 7^ by assumption, we then deduce that V has 
an unbounded competitive ratio, which proves the lemma by contrapositive. 



F Proof of Theorem I3T241 

We prove that for any control design method T G C\{F e }, there exists a plant 
P = (A,B,x ) G V such that J P (T(A,B)) > J P (T e (A,B)). Like in the proof 
of Theorem 3.6, we partition the set of limited model information control design 
methods C as follows 

C = C c U Wo U Wi U W 2 U {F 6 }, 

where 

C := {F G C\3Ai : M" lX " x M" lXrl ' M" lX "% 

tr(A,S)]< - AidA^BuftAk, for alH = !,■•• ,q}, 
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Wo := {r eC, 3i G {q - c+ 1, . . . , q} such that A,([A] 4 , B u ) + W l ([A] l , B u ) }, 
with Wi defined as in equation (|2TT) . 

Wi := {r G £ \ W \3i G {1, • • • , q - c}, 3j 7^ i and A y € R^*"^ nonzero 
such that/ + B !;i A 4 ([0 • • • 0i tJ • • • 0] , B u ) ^ 0}, 

and 

W 2 := {re £\W UWi|3i 6 {l,--- ,<?-c}, [i],er xn , 

with appropriate structure such that I + BuAi([A}i, Ba) 7^ 0}. 

First, we prove that T e is undominatcd by control design methods in £ c . Let 
r G £ c and let i be such that there exists a plant with matrix A with the property 
that subcontrollcr [r] Bu) T does not belong to the linear subspacc spanned 

by the columns of [A}J . Iil<i<q — c then, proceeding as in the proof of 
Theorem 13.131 we can find matrices A, B and initial condition xo such that 
Jp(T(P)) > J P (T A (P)) = J P (T e (P)) for P = (A, B, x ) (with the last equality 
following from the structure of matrix A). Hence, without loss of generality, we 
assume that q — c + 1 < i < q. Consider matrix A defined as [A]i = [A]i and 
[A]j = for all j 7^ i. For this particular matrix A and any B, xq we know 
from the proof of the "only if" part of the Theorem 13.131 that T®(A, B,Xq) 
is the globally optimal controller. Hence, every other control design method 
in C leads to a controller with greater performance criterion than T for this 
particular type of plants. Therefore, the control desig n r e is undominated by 
control design methods in £ c . 

The same reasoning shows that T is also undominatcd by control design 
methods in Wo- 

We now prove that T e is undominated by control design strategies in Wi. 
Let reWi and let 1 < i < q - c be such that (I + Buki(\A] u B u )) ^ where 
[A]i = [0 • • • Aij • • • 0] for some j 7^ i. This means that there exists at 
least one i\ G li and j\ G Ij such that di 1 j 1 7^ and Sj ui + &i 1 ii7i 1 j 1 {A, B) 7^ 0. 
Because subsystem i is not a sink (since 1 < i < q — c), we know that there exists 
az^i such that (s-p) Z i 7^ 0. Iil<z<q~c we can again proceed as in the 
proof of Thcorem lXT3l to construct a plant P for which J P (T(P)) > J P (T e (P)). 
Thus, without loss of generality, we assume that q — c + 1 < z < q. Choose an 
index z\ G T z and consider the matrix A defined by [A]i = [A]i, a Zl i 1 = r and all 
other entries equal to zero. Then, [T(A,B)]i = Ai([A]i, Bu)[A]i, [T(A,B)] Z = 
-b ZlZl /(l + b 2 ZiZi )[A] z (because T <£ W U£ C ), and [T(A,B)] t = for all* + i,z. 
Denoting T(A, B) by K, we see that 

J { a,b^(A,B)) > xl[(A + BK) T K T K(A + BK) 

+((A + BK) 2 ) T (A + BK) 2 ]x 

for all B G B{e) and xq. Taking xq = then results in 

J C A, B , ejl )(r(A,B)) - j {A ^ e]i) (r e (A,B)) > 

i^xiii + ( r + b ZlZl k Zlil ) 2 ](a il j 1 + b ilil k il j 1 ) 2 — ^ "TF~- 

Note that, irrespective of the choice of the controller gain k Zl i t , 
k 2 Zlll + (r + b ZlZl k Zlll ) 2 >r 2 /(l + b 2 ZlZl ), 
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and as a result, 



lim + (r + b ZlZl k Zlil ) 2 ](a ilh +h A k^ h f = +00, 

because 7^ 0. Hence, we can always construct A with appropriate 

choice of index z and a scalar r large enough to make the cost difference positive. 
As a result, T cannot dominate r e . 

Finally, we prove that T is undominated by control design methods in W^- 
Let r g W2 and index 1 < i < q — c and model sub-matrices [A]i and Ba such 
that / + Ai([A]i, Bu) 7^ 0. Therefore, we know that there exists at least one 
index i\ G Ij such that A ix 7^ and A il + b il i i r il (A, B) 7^ 0. Based on the fact 
that node i is not a sink, we know that there exists z 7^ i such that (s-p) Z i 7^ 
0. For the same reasons as before we again restrict ourselves, without loss of 
generality, to the case where q — c + 1 < z < q. Consider the matrix A defined 
by [A]i = [A]i and a Zl i 1 — r and all other entries of A equal to zero. Then, 
[A]i + \T(A,B)]i = (/ + A i ([ J 4] i ,B«))[A] i and [T(A,B)) Z = -b zlzl /(l+b 2 ZlZ1 )[A] z 
(because r ^ W U C c ). Again, K will stand for T(A, B). Then, for all B £ B(e) 
and xq 

J(A,B,x Q ) 

(T(A 7 B))-J {A ^ Xo) (T e (A,B)) 
> x^(A h +b lin r n (A,B)) T (A n +b nil T il (A,B))x x 

r 2 b 2 ZlZ J(l + b 2 ZiZi f - J2 x^AfA t x /b 2 t , 
teii 

and hence, since A^ + bi^T \ 1 {A 1 B) 7^ 0, we can choose r large enough to 
ensure that this difference is strictly positive for some xo S K n since the inner 
matrix will have a strictly positive eigenvalue for large values of r. Thus, the 
control design strategy T £ W2 cannot dominate the control design T e . 



35 



